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Abstract 

We argue that there is a fundamental problem regarding the analysis that serves as the foundation 
for the papers Information theory explanation of the fluctuation theorem, maximum entropy pro- 
duction and self- organized criticality in non- equilibrium stationary states [R. Dewar, J. Phys. A: 
Math. Gen. 36 (2003), 631-641] and Maximum entropy production and the fluctuation theorem 
[R. Dewar, J. Phys. A: Math. Gen. 38 (2005), L371-L381]. In particular, we demonstrate that 
this analysis is based on an assumption that is physically unrealistic and that, hence, the results 
obtained in those papers cannot be regarded as physically meaningful. 
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In this paper, we consider two works that have been quite influential in recent 

studies in the fields of atmospheric science, environmental science and ecology, particularly 
in connection to the so-called principle of maximum entropy production [3j. We find that 
these works are seriously flawed. Specifically, we argue that the variational derivation on 
which they are based begins with the assumption of a condition that is physically unfeasible 
and that, thus, although the computation itself is correct, its result lacks physical meaning. 
We then provide a particular example that demonstrates this point explicitly. 

In Ref. the author derives an expression (Eq. (5) there) that is claimed to be the 
probability distribution for the microscopic trajectories of a general open system. This 
probability distribution is the fundamental result on which Refs. fl and Q are based. He 
then proceeds to derive from this fundamental result a number of secondary results (the 
fluctuation theorem, a condition of maximum entropy production as the selection principle 
for non-equilibrium steady states, behavior representing the emergence of self-organized 
criticality, and relations that indicate the connection between the fluctuation theorem and 
the maximum entropy production selection principle). Several years after the appearance 



,fl 



of Refs. |1| and (2j, there appeared two works that criticize the derivations of some of these 
secondary results. Bruers [4| pointed out a possible problem involving an assumption made 
in Ref. [lfl that is needed to obtain the maximum entropy production selection principle. 
There it is claimed that the proper assumption in fact leads to a prediction of minimum 
entropy production. Later, Grinstein and Linsker |5j elucidated two separate problems 
involving the use of two approximations beyond their regimes of validity, in the derivation 
of the result representing self-organized criticality in Ref. fl, and in the derivation of the 
relations connecting the fluctuation theorem to the non-equilibrium steady state selection 
principle in Ref. [2|. These are important points. However, they all regard analysis that 
appears subsequent to the derrvatron of the fnndamenta! resu,t, Eq. (5) of Ref. fl. These 
papers point out possible problems in the application of this fundamental result, but they in 
no way call into question this result itself. By contrast, the problem demonstrated presently, 
which regards the derivation of the fundamental result, is more serious and casts doubt on 
the merit of the information theoretic approach proposed in Ref. 1|. 

As stated above, in Ref. [1], the author attempts to derive the stationary probability 
distribution for the (classical) microscopic trajectories of a general open system, exchanging 
energy and particles with its environment. He does this using a variational approach, assum- 
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ing that it can be accomplished by maximizing the generalized entropy — X)» P(Xi) ^ogP(Ti), 
subject to the proper conditions. (Note that to suit the present purposes, here and below 
we use notation that differs slightly from that in the original.) Here, I\ represents the ith 
trajectory between some specified initial and final times (which we choose as t = and 
t = r), P{Ti) is its probability, and the sum is over all possible trajectories between these 
times. The author assumes that in order to obtain the correct distribution, the only physical 
quantities to which constraints must be applied are the energy density and particle densities 
at each point in the system, expressed collectively as d(x, t), and the energy flux and particle 
fluxes at every point on the boundary of the system, expressed as F(x,t). In fact, as the 
constraints imposed in the variation, the author uses only the following: 

E p ( r *) = i, 

i 

Y,P(Ti)di(x,0) = A(x) for a; G V , 

i 

£ P(Ti)Fi(x) = B(x) for igSI. (1) 

i 

Here, di(x, 0) is the initial value of d(x,t) for the ith trajectory, Fi(x) is the time average 
of F(x,t) taken over the entire ith trajectory, A(x) and B(x) are some specified functions, 
fixing the ensemble averages (di(x, 01) and (Fi(x)), and V and Q represent the system and 
its boundary, respectively. In Refs. [l] and [2^, it is claimed that the proper form of P(Ti) 
can be obtained by maximizing the above generalized entropy subject to these constraints 
alone. 

The most important point to note here is that in the proposed variation, nothing dis- 
tinguishes between two arbitrary trajectories Tj and Tj that satisfy the relations di(x,0) = 
dj(x,0) and Fi(x) = Fj(x). Hence, it is implicitly assumed that the probabilities of any 
two trajectories with identical initial conditions and average fluxes are equal. This is seen 
clearly in the resulting probability distribution, appearing in Eq. (5) of Ref. [lj], P(Ti) = 
Z^ 1 exp[— A(Tj)] with Z = J2i exp[— A(Fj)] and A(Ti) = f v X(x)-di(x, 0)dx+f Q r)(x)-Fi(x)dx, 
where X(x) and r](x) are Lagrange multipliers. Although this is not the final form of -P(I\) 
used there, subsequent manipulations serve only to express the same quantity in a different 
manner; that is, there is no additional quantity introduced into that would alter the 

assumption stated above. On the basis of physical considerations, however, this appears 
to be an unrealistically strong assumption, as it implies that a trajectory along which the 
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energy or quantity of material possessed by a system fluctuates wildly and one along which it 
fluctuates very gently will have equal probabilities as long as they have the same initial and 
final states. Below, we investigate this point by considering a particular system, described 



by the prototypical model of therma 
indeed, the assumption made in Ref. 



fluctuations. From this investigation we find that, 
l| is physically invalid. 



In this paper, we investigate the validity of the approach presented in Ref. [l( by consid- 
ering the dynamics described by the following Langevin equation: 

a(t) = -(a(t) + Z(t) ■ (2) 

Here, a can be regarded as an arbitrary extensive quantity representing the state of a ther- 
modynamic system that is contact with a (heat and/or particle) reservoir. The interaction of 
the system with the reservoir is characterized by (, a positive constant, and a stochastic 
force whose statistics are independent of a and t. The Langevin equation considered here 
has been investigated for more than a century [6[, and while it was originally studied as a 
model of Brownian motion, its physical validity has been firmly established in many con- 
texts. It is regarded as a prototype of the stochastic models used to describe open systems, 
as it represents perhaps the simplest model of fluctuations that result from the accumulation 
of many microscopic processes. Due to its minimal nature within such a class of models, the 
behavior it describes is observed quite universally among systems exhibiting fluctuations of 
this kind. Indeed, fl2]) represents the generic equation of motion for a single fluctuating ther- 



modynamic quantity in the linear response regime (Although this assumes that spatial 
gradients of a can be ignored, even if they cannot be ignored, the essential nature of the 



description is unchanged {9].) For example, the dynamics of a described by this equation 
can be used to model fluctuations undergone by the concentrations of the chemical species 
participating in a chemical reaction within some region. 

Here we consider the simple case in which £ is a zero-mean, Gaussian-distributed stochas- 
tic force with delta-function time correlation. We also assume that the coefficient ( and the 
intensity of £ are related by the fluctuation-dissipation theorem of the second kind. This im- 
plies that, for example, in the case of a Brownian particle, we have (£(£)£(£')) = 2£Tm8(t—t') 
(where m is the mass of the Brownian particle and T is the temperature of the heat bath), 
while in the case of a chemical reaction, we have (f (t)f (*')) = 2(T (j^ij Wja^) <K* ~ £ ') 
(where z/j, /ij and n« are the stoichiometric coefficient, the chemical potential and the con- 



centration of species i, respectively). 

From this point, for convenience, we regard (j2J) as describing a Brownian particle. How- 
ever, it should be kept in mind that this analysis and the conclusion to which it leads apply 
to a very wide range of systems, including spatially extended systems of many kinds. 

Let us first rewrite d2J) to make its present application clearer: 

P=-— P + £- (3) 

m 

Here, p is the momentum of the Brownian particle, m is its mass, and 7 is the friction 
constant. Because the system here consists only of the Brownian particle, which is treated 
as a point mass, the quantities di(x, 0) and Fi(x) are simply the initial kinetic energy of the 
particle and its average rate of change over a trajectory. 

We now derive the probability for a trajectory of this Brownian particle. We begin by 
noting that in the general case of Gaussian noise, the probability for the realization of a 
particular value of £ is given by 

P(0 = cexp[-(£-(0) 2 /2((£-(£)) 2 )], (4) 
where c is a normalization constant. For a system of the type that we consider, this becomes 

P(0 = cexp[-^ 2 /4 7 T] , (5) 

where dt can be regarded as the timescale of the description. It is important here that c 
depends only on dt, 7 and T (and, of course, the number of spatial dimensions). From 
this, noting the Markovian nature of the system, we immediately obtain the probability for 
a finite- length trajectory T, given the initial state p(0), realized under a particular noise 
history, 

P(T\p(0)) = Cexp[- r^ 2 (t)/4 7 T] , (6) 

Jo 

where C depends on r, 7 and T only. 

Now, let us consider the set of all trajectories satisfying p(0) = p(r) = 0. Clearly, for any 
a > 0, there exists a realization of £(£) (in fact, infinitely many) such that Jq dtC, 2 (t) = a 
and the resulting trajectory is an element of this set, given the initial condition. However, 
the total change in the energy of the system over each such trajectory is zero. Thus, for all 
of these trajectories, both the initial conditions and the average fluxes are identical. Never- 
theless, two such trajectories with distinct values of J T dt£ 2 (t) possess different probabilities. 
This contradicts the assumption on which the derivation of P(T) in Ref. jj is based. 



To explicitly demonstrate this point, let us consider the set of trajectories for which p(t) 
takes the form p(t) = A sin(7rt / V) . Then, substituting p + 3-p for £ in the above integral, a 
trivial calculation yields 

n r^2 /n ,\2 

A 2 . (7) 
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Thus, for distinct values of \A\, the corresponding trajectories have distinct values of J T <it£ 2 , 
and indeed for any non-negative value of /J" <it£ 2 , there exists a trajectory of the above form 
for which this value is realized. 

The case considered above is that in which the asymptotic state of the system is equilib- 
rium. Next, we note that the situation is essentially unchanged if instead of (jBJ) we consider 
the equation 

p = --p + / + £, (8) 
m 

where / represents a constant driving force, independent of space and time. For a system 
described by this equation with nonzero /, the asymptotic state is a non-equilibrium steady 
state. All of the above analysis can be applied to this equation as well, and in this case, 
using the same form of p(t) as above, we obtain 

A 2 --^frA + f 2 r. (9) 
7r m 

While we could consider further generalized forms of (j3J) , it is sufficiently clear that the main 
conclusion in each case would be the same. 

The problem of deriving probability distributions for non-equilibrium steady states has 
been studied for many years. This is an extremely difficult problem, and to this time, except 
in certain simple cases, exact expressions - even for single-time distribution functions - have 
been obtained only in non-explicit forms jg]. Noting that non-equilibrium steady states are 
realized as asymptotic fixed-point solutions, it is natural to conjecture that such states, like 
equilibrium states, correspond to minima of some quantity characterizing the state space, 
i.e., some kind of non-equilibrium thermodynamic potential. Thus, the variational approach 
employed in Ref. [l| is intuitively appealing. However, the main difficulty involved in such 
an approach is that there exists no general principle that allows us to identify the proper 
constraints to be used in the variational procedure. In the equilibrium case, the principle 
of equal probability of micro states provides the information needed to obtain the single- 
time probability distribution. In the linear-response regime, this principle, through the 
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linear phenomenological laws, provides the same information for distributions of finite-length 
trajectories |7|. However, because we do not know of any such principles that apply outside 
of these limited regimes, the problem of obtaining generally valid probability distributions 
for non-equilibrium steady states remains unsolved. 
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